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DETAILED ACTION 

1 . The amendment filed on 10 April 2008 have been received and entered. Claims 
1,4-11, 13-20 and 22-29 as amended are pending in the application. 

Claim Objections 

2. Claim 26 is objected to because of the following informalities: The preamble of 
claim 26 fails to include wording such as "comprising", "consisting of, etc. to include 
the rest of the claimed limitations. Appropriate correction is required. 



Claim Rejections - 35 USC § 102 

The following is a quotation of the appropriate paragraphs of 35 U.S. C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

3. Claims 1, 3-4, 9-11, 13, 18-20 and 22-27 are rejected under 35 U.S.C. 102(b) as 
being anticipated by Pinard U.S. Patent 5,898,432. 

Referring to claims 1 and 1 1 , Pinard teaches a method and system comprising a 
memory that stores associations between at least one activity stream and at least one 
representation element, the activity stream based on an activity beyond a perception of a 
user (for example, associating the activity steam of a received electronic mail message 
with the displayed appearance of a mail message cursor icon 25 shown in Figure 4) 
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(column 1, lines 52-67 and column 4, lines 1 1-16); at least one synthesizer circuit, 
synthesizing a human sensible attribute of at least one representation element responsive 
to changes in the at the least one activity stream and the stored associations (synthesizing 
the displayed cursor icon based on changes; for example, the displayed cursor icon can be 
modified to a fax cursor icon in order to indicate changes in the activity stream, such as 
arrival of a new fax) (column 4, lines 11-16); determining a focus of attention of the user 
(user's focus of attention is determined by the position of the cursor) (column 1, lines 52- 
63); selecting at least one of the at least one representation elements at a periphery of the 
focus of attention (displaying the icon at the periphery of the cursor, which is the current 
focus of attention, i.e. attaching the icon to the cursor, as shown by Figures 2-5) (column 
3, lines 57-61); presenting the synthesized human sensible attribute using the selected at 
least one representation element to the user (the position of the cursor changes according 
to user movement and represents the user's focus of attention; upon the arrival of a new 
mail, the displayed appearance of the cursor representing the user's focus of attention is 
changed to be presented as a mail icon) (column 1, line 52-column 2, line 9); and 
dynamically changing the human sensible attribute of the at least one representation 
element responsive to dynamic changes in the at least one activity stream (the human 
sensible attribute of the representation element, i.e. the displayed form of the cursor icon 
dynamically changes as the received function changes, i.e. as the system receives a fax, 
telephone call, etc.) (column 4, lines 5-31), wherein varying portions of a graphical user 
interface associated with the at least one representation element are being used in 
informing the user of the changes in the at least one activity stream (different 
representation elements, i.e. the mail icon, fax icon, telephone icon, etc. are displayed on 
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varying portions of the graphical user interface, i.e. as the user moves the cursor around 
on the screen, in order to inform the user of changes in the activity stream, i.e. the arrival 
of new mail, new fax, new call, etc.) (column 1, line 52-column 2, line 9 and column 3, 
line 33 - column 4, line 27). 

Referring to claims 4 and 13, Pinard teaches wherein the activity stream is 
information including external sensor information (alerts that are sensed from external 
devices such as telephones can be used to notify the user of important information, i.e. 
arrival of an incoming call) (column 2, lines 17-19 and column 3, line 62 - column 4, line 
27). 

Referring to claims 9 and 18, Pinard teaches the human-sensible attribute is a 
display attribute (display of an icon) (Figures 2-5). 

Referring to claims 10 and 19, Pinard teaches the display attribute includes at 
least one of a text characteristic, a window characteristic, a desktop characteristic 
(displaying icons on the desktop) (Figures 2-5). 

Referring to claim 20, Pinard teaches determining a users focus of attention by 
actively sensing the user's focus of attention (user's focus of attention is sensed by the 
position of the cursor) (column 3, lines 33-40). 

Referring to claims 22-23, Pinard teaches wherein the activity is at least one of a 
scheduled event approaching and sensor values changing (sensing the activity of a change 
in the message sent by the application program; for example, when the change of arrival 
of an email is detected, the icon is correspondingly changed) (column 1, line 52-column 
2, line 9 and column 3, line 33 - column 4, line 27). 
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Referring to claims 24-25, Pinard teaches wherein the activity stream comprises 
information including at least one of external sensor information, telephone information, 
broadcast news information and pager information (alerts that are sensed from external 
devices such as telephones can be used to notify the user of important information, i.e. 
arrival of an incoming call) (column 2, lines 17-19 and column 3, line 62 - column 4, line 
27). 

Referring to claim 26, Pinard teaches a method comprising determining the focus 
of attention of the user (user's focus of attention is determined by the position of the 
cursor) (column 1, lines 52-63); detecting a change in an activity stream (synthesizing the 
displayed cursor icon based on changes; for example, the displayed cursor icon can be 
modified to a fax cursor icon in order to indicate changes in the activity stream, such as 
arrival of a new fax) (column 4, lines 11-16), the activity stream occurring outside of 
perception of the user (for example, associating the activity steam of a received electronic 
mail message with the displayed appearance of a mail message cursor icon 25 shown in 
Figure 4) (column 1, lines 52-67 and column 4, lines 11-16); determining a representation 
element associated with the activity stream, the representation element having human 
sensible attributes (the cursor is modified to display a representation element, i.e. a fax 
icon associated with the arrival of a new fax) (column 4, lines 11-16); and dynamically 
changing the human sensible attributes responsive to the dynamic change in the activity 
stream (the human sensible attribute of the representation element, i.e. the displayed form 
of the cursor icon dynamically changes as the received function changes, i.e. as the 
system receives a fax, telephone call, etc.) (column 4, lines 5-31), wherein the changing 
of the human sensible attributes is adapted to be sensed by the user in the periphery of 



Application/Control Number: 09/788,603 Pag 
Art Unit: 2173 

attention of the user (displaying the icon at the periphery of the cursor, which is the 
current focus of attention, i.e. attaching the icon to the cursor, as shown by Figures 2-5) 
(column 3, lines 57-61). 

Referring to claim 27, Pinard teaches wherein the human sensible attributes are 
selected from vision, sound, touch, taste and smell (displaying the icons on the screen) 
(Figures 2-5). 

Claim Rejections - 35 USC §103 

The following is a quotation of 35 U.S. C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

4. Claims 5-8 and 14-17 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Pinard U.S. Patent 5,898,432, as applied to claims 1 and 1 1 above, and Tavori U.S. 
Patent 5,724,025. 

Referring to claims 5 and 14, Pinard fails to teach that the human-sensible 
attribute is synthesized based on a selected range. Tavori teach a computer with a 
graphical display for displaying monitored information similar to that of Pinard. In 
addition, Tavori further teaches wherein the human-sensible attribute is synthesized 
based on a selected range (a human-sensible attribute such as an alarm may be set off 
based on a range, i.e. upper and lower limit set points) (Tavori: column 2, line 46-column 
3, line 15). It would have been obvious to one of ordinary skill in the art, having the 
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teachings of Pinard and Tavori before him at the time the invention was made, to modify 
the user interface for synthesizing the human-sensible attribute of Pinard to include the 
use of a selected range taught by Tavori. One would have been motivated to make such a 
combination in order to provide standardized/set limits and guidelines for when alerts 
should be presented to the user; the combination further allows the interface to be used 
for medical purposes facilitating the monitoring and displaying of measured patient 
information, allowing fast and accurate diagnosis of the patient and allowing immediate 
alerts of medical emergencies when alarmed conditions occur. 

Referring to claims 6 and 15, Pinard, as modified, teach wherein the human- 
sensible attribute is synthesized based on values outside a selected range (the human- 
sensible attribute of the alarm is set off when the monitored data exceeds, i.e. is outside 
of the set limits) (Tavori: column 2, line 46-column 3, line 15). 

Referring to claims 7 and 16, Pinard, as modified, teach wherein the at least one 
activity stream has a value outside a predicted range of values (the monitored activity 
streams of the user's vital signs can exceed the set limits, setting off the alarm) (Tavori: 
column 2, line 46-column 3, line 15). 

Referring to claims 8 and 17, Pinard, as modified, teach determining the predicted 
range of values based on monitoring at least one of the at least one activity stream 
(monitoring activity streams such as the user's vital signs to determine whether the 
monitored values exceed a set range) (Tavori: column 2, line 46-column 3, line 15). 
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5. Claims 28-29 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Pinard U.S. Patent 5,898,432, as applied to claim 26 above, and Ferrel et al. U.S. Patent 
5,860,073 (hereinafter "Ferrel"). 

Referring to claim 28, although Pinard teaches changing the human sensible 
attributes, Pinard fails to explicitly applying a dynamic stylesheet to the representation 
element. Ferrel teaches a method for changing the display of an object similar to that of 
Pinard. In addition, Ferrel further teaches applying a dynamic stylesheet to the 
representation element (the objects displayed in a document can be modified to be 
displayed differently) (Ferrel: column 3, lines 8-15 and column 27, lines 52-55). It would 
have been obvious to one of ordinary skill in the art, having the teachings of Pinard and 
Ferrel before him at the time the invention was made, to modify the changing of the 
human sensible attributes of a displayed object of Pinard to include the changing of 
attributes of objects via dynamic stylesheets, as taught by Ferrel. One would have been 
motivated to make such a combination in order to allow fast and efficient delivery of a 
plurality of formatting information to displayed elements. 

Referring to claim 29, Pinard, as modified, teach authoring the dynamic stylesheet 
(Ferrel: column 3, lines 45-53) including obtaining a selected activity stream from among 
a plurality of activity streams (displaying a selected activity stream, such as the arrival of 
a new mail, among a plurality of activities, including fax, telephone, etc.) (Pinard: 
column 1, line 52-column 2, line 9 and column 3, line 33 - column 4, line 27); and 
specifying variations to the human sensible attributes of the representation element 
responsive to changes in the selected activity stream (different representation elements, 
i.e. the mail icon, fax icon, telephone icon, etc. are displayed in order to inform the user 
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of changes in the activity stream, i.e. the arrival of new mail, new fax, new call, etc.) 
(Pinard: column 1, line 52-column 2, line 9 and column 3, line 33 - column 4, line 27), 
wherein the variations in the human sensible attributes indicate, unobtrusively to the user, 
the changes in the selected activity (displaying the icon at the periphery of the cursor, 
which is the current focus of attention, i.e. attaching the icon to the cursor, as shown by 
Figures 2-5) (Pinard: column 3, lines 57-61). 

Response to Arguments 

6. Applicant's arguments filed 04/10/2008 have been fully considered but they are 
not persuasive: 

7. The applicant stated that the examiner has indicated that the foregoing claim 
amendments overcome the cited prior art in the interview conducted on 02/1 1/2008. The 
examiner respectfully disagrees. Language stating that the periphery of the user's focus 
of attention is separated by at least some distance from the current position/location of the 
user's focus of attention and the intensity of the representation element's attribute 
increases over time (i.e. representation element that keeps getting louder, darker in color, 
etc.) were discussed during the interview as possibly overcoming the previous cited 
rejection of record (see Interview Summary dated 02/25/2008). However, the claim 
amendments as currently filed do not incorporate those limitations as discussed; 
therefore, the examiner respectfully maintains that the foregoing amendments do not 
overcome the cited art. 
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8. With respect to independent claims 1,11 and 26, the applicant argues that Pinard 
teaches a static icon , whose shape is fixed , and therefore, Pinard does not teach or suggest 

"dynamically changing the element responsive to dynamic changes in the. . .activity 

stream". The examiner respectfully disagrees. As a first note, the examiner respectfully 
points out that the claim language, as presently recited, do not specifically state that the 
shape of the representation element is changed. Regardless, the examiner respectfully 
argues that the shape of the cursor icon is not fixed. Figure 3 shows that the shape of the 
cursor icon 25 is one of a cursor attached with a telephone set; Figure 4 shows that the 
shape of the cursor icon 25 is one of a cursor attached with an envelope; Figure 5 shows 
that the shape of the cursor icon 25 is one of a cursor attached with a fax; therefore, each 
of the figures shows a cursor icon of a different shape. Pinard teaches that as the at least 
one activity stream (incoming function) dynamically changes, the human sensible 
attribute (displayed form) of the at least one representation element (cursor icon) also 
dynamically changes to represent/reflect the different incoming functions. Pinard 
specifically states that "FIG. 4 illustrates the cursor having been changed to cursor 25 
having a form that indicates that an E-mail message is waiting, and FIG. 5 illustrates the 
cursor having been changed to cursor 25 that indicates that a fax message is being or has 
been received", in column 4, lines 11-15; furthermore, Pinard states "... . automatically 
changing the form of the cursor upon occurrence of an event which requires attention by 
the user. For example, the form of the cursor can be changed upon receipt by the 
terminal of a signal indicating at least one of ringing a telephone, an E-mail message 
waiting to be read, the receipt of a fax, and an alarm", in column 1, lines 61-67, and 
"... .change the form of the cursor that is displayed to one appropriate to the incoming 
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function", in column 4, lines 28-3 1 . Therefore, Pinard teaches that the same cursor icon, 
namely cursor icon 25 shown in Figures 3-5, changes its human sensible attribute, i.e. its 
displayed form to one of a displayed telephone set (Figure 3), displayed envelope (Figure 
4) and displayed fax (Figure 5), in response to changes in the activity stream of an 
incoming phone call, incoming email message and incoming fax, respectively. Since the 
displayed form of the cursor icon 25 changes in accordance with changes in the activity 
stream, the cursor icon 25 is not static. The word "dynamic" is defined as ". . .actions that 
take place at the moment they are needed rather than in advance" 
( http://www.webopediaxom/TERM/d/dvnamic.html ). As mentioned above, Pinard 
specifically recites "... . automatically changing the form of the cursor upon occurrence of 
an event which requires attention by the user. For example, the form of the cursor can be 
changed upon receipt by the terminal of a signal indicating at least one of ringing a 
telephone, an E-mail message waiting to be read, the receipt of a fax, and an alarm", in 
column 1, lines 61-67. Therefore, in view of the definition of "dynamic", the cited 
teachings of Pinard, and the above response to arguments, the examiner respectfully 
maintains that Pinard teaches "dynamically changing the human sensible attribute of the 
at least one representation element responsive to dynamic changes in the at least one 
activity stream". 



9. With respect to dependent claims 3-4, 9-10, 13, 18-20, 22-25 and 27, the applicant 
argues that the rejection of these claims are moot in view of their dependence on the 
patentable amended independent claims 1,11 and 26. The examiner respectfully 
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disagrees and refers to the response to arguments with respect to claims 1,11 and 26 in 
section 8 above. 

10. With respect to claims 5-8 and 14-17, the applicant argues that Tavori does not 
cure the deficiencies of Pinard as identified with reference to independent claims 1,11 
and 26. The examiner respectfully disagrees and refers to the response to arguments with 
respect to claims 1,11 and 26 in section 8 above. 

1 1 . THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of 
time policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE -MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of the 
advisory action. In no event, however, will the statutory period for reply expire later than 
SIX MONTHS from the mailing date of this final action. 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to TING ZHOU whose telephone number is (571)272-4058. 
The examiner can normally be reached on Monday - Friday 9:00am - 6:00pm. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Dennis Chow can be reached on (571) 272-7767. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. Status 
information for unpublished applications is available through Private PAIR only. For 
more information about the PAIR system, see http://pair-direct.uspto.gov. Should you 
have questions on access to the Private PAIR system, contact the Electronic Business 
Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO 
Customer Service Representative or access to the automated information system, call 
800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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Primary Examiner, Art Unit 2173 
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